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Correcting data for attenuating measurement error is now vzidely 
recognized as an essential procedure whenever the researcher is interested 
in relationships among the true scores of the variables. Use of the usual 
bivariate correction for attenuation with more than two variables, however, 
presents two statistical problems. This pairwise method may produce a 
covariance matrix which i^ot at least positive semi-definite. Further- 
more, the bivariate procedure does not consider the possible influences of 
correlated errors among the variables. The method described here, a 
generalized correction for attenuation, is a multivariate method which 
accommodates both the negative variance component problem and the collinear- 
ity problem. 

In the p-variate case, we shall consider two components of the 
theoretical observed covariance ^jy • ^> the true covariance matrix and 
the error covariance matrix or 

2y ^ ^ T l!iE 

Theoretically, we can find the true covariance matrix by simply re- 

arranging the equation. Since is exactly equal to Xt + ^^^^ 
2f Y- ^T 2iY " ^E^O* With estimates S of these theoreti- 

cal 2*s, we cannot be certain that Sf = Sy - Sg^O. It is entirely 
possible that Sy^ Sg, giving a non-positive semi-definite matrix for S.j,. 

There is an obvious algebraic solution to this dilemma. We can 
simultaneously diagonalize Sy and Sg using the spectral decomposition 
(Rao, 1965). Since both of these are real symmetric matrices, and Sg is 



positive* definite, uhere exists a non-singular matrix T such that 

T' Sy T = L and i* Sg T = I 
where L :ls a diagonal matrix and I is the identity matrix. The diagonal 
elements of L, Ij^ ^ ... ^ Ip, of L arc the roots of / Sy - 1 Sg/ = 0. 
The ith column vector T^ of T satisfies SyT^ = li Se T^. If 1^2 1 for all 
i then, 

S»p ~ Sy Sjg 

= B' L B « B'B where B = T"^ 

- B' (L-I) B 

= B' L* B. 
If we restrict the 1^ so that 

lj_* = max(l^-l,0) for all i 
we can iisure that Srj, is at least positive semi-def iiiite. 

'flhile the algebraic solution just described solves the negative 
variance component problem, it would l)e more reassuring to know that the 
resulting estimates possess desirable properties such as maximum likelihood 
properties. We will now show that these estimates are maximum likelihood 
estimates. 

S is a sample covariance matrix with n degrees of freedom and is an 
unbiased estimate of 2. S has a Wishart distribution with density function 

fCS)=C(S) 12/ ""/^ exp(-|tr sZ'S 

where C(S) = C(s|^ (n-p-1) ^ constant. 
The joint log likelihood equation is 

log U2y> ?e) = Cs - ^ loglfyl - ^ h^Y^ 



Recall that = B* LB and Se = B*B. 

Substituting these expressions into the log likelihood equaJ^ion and rear- 
ranging terms in the trace: 

= Cs-|Yiog/^J -^tr(LB2;-l B') 

Let us define new parameters P and Q such that 

Q = B'-l 2y ^ = B'~l 2e b"^. 

The determinants after this reparameterization then are 

det Q = (det B) det 
and det P = (det B) ~ det 
The logs of the determinants of 

log/^'y/ ■- 2 log /b| + log /qI 
= C + log (qI 
aid log (ggl = C + log \?i 
The log likelihood equation is now 

Jt-^S'^ log iQl - ^ tr L Q-1 - iHE log/p| - f^E -1. 
^ 2 2 2 " 

We can show that the determinant is maximum when the off-diagonal 

elements are zero. Since we want the maximum solution we can focus on the 

diagonal elements of the determinants and hence the diagonal elements of 

all terms in the equation. So now 

C's + ^ log|Q-l| + ^ lop. ( P-1|- £Y tr L - ^ Pq 

where the subscript D denotes that we are 
sidering only the diagonal elements of the matrix* 

i-i ~ " ^ " ~ 

where p^^ is the Inverse of the ith diagonal element 
of P. 

Therefore we can maximize each 1^ separately and we have reduced 
the problem to a univariate one. In differentiating to solve the equation 
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we must consider the restriction on the parameters in order to achieve a 
positive semi-definite matrix for Sj. This constraint, in terms of the new 
parameters, is that q^^^p^i or qn-Pii- If we consider the unrestricted 
problem, the maximum likelihood estimates are 

Pii ^ ^ii ~ "'•ii* 

Since we cannot insure that the constraint above will not be violated by 

these unrestricted estimates, we must consider the restricted estimates. 

One technique for incorporating restrictions into maximum likeli- 
hood estimation is the application of Kuhn-Tucker conditions, assuming 
that the constraint is convex and dif f erentiable. This assumption holds 
with the constraint ±u this problem so the conditions are 

ITi (q^^ " P^^) - 0 forFi ^ 0 and 
\g i ^S- 

^ - • ^ = 0 where u is q" or p^^ and g^ ^TTiCq^H^^) 



for the equation 



^ u c) u 



ny , , n-j ny n^ 

jfi = Y q" + Y - 2 - F P^^- 



The two equations to be solved for the restricted estimates are 

J-Pii -F -TTi = 0 (1) 
ny ny 

ii ii 

The first Kuhn-Tucker condition implies that q =» p indicating that the 
restricted solution is on the boundary. Solving (1) and (2) above: 

Pii = = qii , 



Recall th'it 

St 



St « B' Q B - B' P B 



Er|c - B' (Q-P) B. 



We have just sho^^m that 

q-lj^ - Pii = Cll - 1 if 1 (unrestricted esclmate) 
(^0 if li^l 

So = B' L* B where li* = max(lj_-l,0). 

Therefore the algebraic estimate i.s the maximum likelihood estimate and 
we can estimate the true covariance matrix in terms of the eigenvecto'^'s and 
eigenvalues of the observed covariance matrix in the metric of the error 
covariance matrix. 

Applications 

Two examples will demonstrate the usefulness of the generalized 
correction for attenuation. The first example uses data from the Louis- 
ville Twin Study (Bock and Vandenberg, 1968). The second example uses data 
from the Tela Research Institute Longitudinal Study (Petersen, 1973). 
Example 1. 

The variables for this example are the subtests of the 

Differential Aptitude Test; Spatial, Numerical, Abstract, Verbal, Mecha- 
nical, Clerical, Spelling, and Sentences. The subjects are monozygotic and 
dizygotic twin pairs. The purpose of the study was to estimate the heri- 
table variation of the mental test scores. The components of the total 
variation are 

covariance matrix of the heritable components 
2en* covariance matrix of the environmental components 
2er' covariance matrix of the measurement error 
The sample quantities used are the mean-product matrices and M^^, for 
within-monozygotic and within-dizygotic pairs, respectively, and are cal- 
culated from the between-twin differences for pairs of variables. The 



expected mean-product matrices are 

The naive estimate then for is My^ - M^. Tables 1 and 2 give these 

mean-product matrices and Table. 3 shows their difference. The mechanical 
subtest has a negative estimated variance due to heredity. In this example 
the heritable covariance is analogous the true covariance and the mean- 
product matrices are analogous to the observed and error matrices. The 
true correlation matrix, analogous to the heritable correlation matrix, 
is given in Table 4. The eigenvalues for this matrix, in Table 5, indicate 
that there are only five dimensions in the data, with only three of thase 
eigenvalues larger than !♦ The eigenvectors corresponding to these eigen- 
values are given in Table 6. The first eigenvector appears to be a general 
factor \jith clerical ability barely included, contrasted with mechanical 
ability. The second eigenvector is primarily spatial, mechanical, and 
clerical ability and the third is abstract reasoning contrasted with cleri- 
cal ability. All three of these factors were consistent with other results 
in the heritability study thus validating, to some extent, the generalized 
correction for attenuation method. 
Example 2. 

The variables for this example are ratings of physical characteris- 
tics for androgenicity. The generalized correction for attenuation was 
used on all sets of data; only the data for males and females at age 18 
are included, here. The error covariance matrix is the variance due to 
differences between raters. Table 7 has the observed correlation matrices 
and Table 8 displays the true correlation matrices after correcting for 
the attenuating measurement error. The error has decreased all the corre- 
lations, some substantially. There were three eigenvalues greater than 



one for females and,ti^o eigenvalues for males. The corresponding eigen- 
vectors were extremely interpretable in terms of the underlying dimension 
of interest. When the error matrices were simply subtracted from the 
observed matrices, there were some negative elements ^n the diagonal in 
all cases. The diagonal elements in this resulting matrix are identical 
to the variances x^hich would be obtained with pairwise application of the 
bivariate correction for attenuation, indicating that this method would 
have produced some negative variance estimates. 

The generalized correction for attenuation described In this paper 
produces estimates for the true relationships among variable This 
multivariate procedure considers the correlated errors and successfully 
deals with the problem of negative variance estimates. 
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TABL1-: 4 



TRUE CORRELATION >L\TRIX 





Spat 


Nuner 


Abst 


Verb 


Mech 


Cler 


Spell 


Spatial 


1.00 














Nuaerical 


-0.15 


1.00 












Abstract 


0.44 


0.21 


1.00 










Verbal 


0.21 


0.69 


0.49 


1.00 








Mechanical 


0.61 


-0.71 


-0.01 


-0.53 


1.00 






Clerical 


0.42 


-0.08 


-0.21 


0.18 


C.49 


1.00 




Spelling 


0.24 


0.49 


0.79 


0.87 


-0.31 


0.14 


1.00 


Sentences 


0.68 


0.14 


0.26 


0.68 


0.02 


0.41 


0.46 



1.00 



TABLE 5 



EIGENVALUES OF TRUE CORRELATION MATRIX 



1 
2 
3 
4 
5 
6 
7 
8 



3.43 
2.48 
1.16 
0.57 
0.37 
0.00 
0.00 
0.00 



TABLE 6 

EIGENVECTORS OF TRUE CORREUTION MATRIX 





1 


2 


3 


Spatial 


-0.21 


-0.53 


-0.15 


Numerical 


-0.34 


0.35 


0.25 


Abstract 


-0.37 


-0.07 


-0.66 


Verbal 


-0.52 


0.08 


0.19 


Mechanical 


0.21 


-0.56- 


-0.17 


Clerical 


-0.08 


-0.42 


0.57 


Spelling 


-0.50 


0.02 


-0.17 


Sertences 


-0.37 


-0.31 


0.26 



ERIC 
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TABLE 1 



DIZYGOTIC BOYS COVAKlANC] 



Lpat 


Numer 


Abst 


Verb 


Spatial 291.32 








Numerical -3.49 


24.94 






Abstract 45.95 


2.17 


55. S4 




Verbal 13.14 


10.85 


10.53 


27.82 


Mechanical 49.48 


-7.98 


3.96 


-6.69 


Clerical 63.75 


2.60 


2.13 


9.. 18 


Spelling 64.19 


25.13 


41.98 


61.97 


Sentences 100.94 


11,52 


19.21 


30.75 



TABLE 2 
MONOZYGOTIC BOYS COVAR 





Spat 


Numer_ 


Abst 


Verb 


Spatial 


71.94 








Numerical 


4.31 


18.84 






Abstract 


19.07 


0.45 


42.72 




V«^rbal 


1.57 


3.0J 


3.32 


14.96 


Mechanical 


1/.77 


10.29 


8.10 


7.47 


Clerical 


13.93 


6.10 


10.25 


3.02 


Spelling 


10.60 


7.56 


-10.84 


9.48 


Sentences 


8.92 


13.92 


10.84 


5.24 



TABLE 3 



CT « CY - CE 





Spat 


Numer 


Abst 


Verb 


Spstial 


219.37 








Numerical 


-7.80 


6.10 






Abstract 


26.89 


i 71 


13.22 




Verbal 


11.57 


7.85 


6.71 


12.85 


Mechanical 


31.70 


-18.26 


-4.14 


-14.16 


Clerical 


49.82 


-3.50 


-8.12 


6,31 


Spelling 


53.59 


17.57 


52.82 


52.49 


Sentenr^s 


92.01 


-2.41 


8.87 


25.51 
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TABLE 7 

CORRELATIONS /uMONG Plf/SICAL VARIABLES AT AGE 18^ 





^'usc 


Shol 


Wst Hips 


Butt 


Thi Legs Calf 


OvRt 


G/BS 


PubH 


Muscles/Fat 




.73 


.58 


.69 


.63 


.49 


.42 


.55 


.78 


.41 


-.05 


Shoulder Width 


.82 




.42 


.54 


.54 


.32 


.27 


.39 


.59 


.37 


.00 


Waist Indentan 


.69 


.68 




.78 


.66 


.43 


.29 


.47 


.75 


.18 


-.18 


Hip Width 


.50 


.52 


.57 




.87 


.58 


.50 


.65 


.86 


.41 


-.11 


Buttocks Shape 


.73 


.66 


.68 


.60 




.64 


.56 


.61 


.81 


.44 


.00 


Thigh Shape 


.56 


.5A 


.64 


.56 


. 66 




.80 


.66 


.64 


.45 


-.07 


Leg Space 


.49 


.40 


.42 


.28 


.67 


.57 




.55 


.56 


.49 


-.13 


Calf Shape 


.03 


.59 


.61 


.41 


.62 


.56 


.42 




.62 


.34 


-.07 


Overall Rating 


.80 


.71 


.73 


.58 


.73 


.67 


.49 


.63 




.45 


-.10 


Gen or Br Size 


.45 


.50 


.39 


.37 


.47 


.43 


.36 


.46 


.46 




-.03 


Pubic Hair 


.19 


.20 


.09 


.26 


.12 


.11 


-.11 


.18 


.34 


.17 





Girls above diagonal, boys below. 
(n=90) (n=106) 



TABLE 8 

CORRECTED CORRELATIONS AMONG PHYSICAL VARIABl.ES AT AGE 18^ 





Muse 


Shol 


Wst 


Hips 


Butt 


Thi Legs Calf 


OvRt G/BS 


PubH 


Muscles/Fat 




.77 


.76 


.92 


.94 


.77 


.64 


.88 


.92 


.69 


-.22 


Shoulder Width 


.99 




.63 


.81 


.79 


.23 


.19 


.49 


.74 


.38 


-.01 


Waist Indentan 


.70 


.65 




.92 


.90 


.51 


.20 


.70 


.88 


.35 


-.21 


Hip Width 


.71 


69 


.76 




.97 


.58 


.40 


.81 


.97 


.62 


-.21 


Buttocks Shape 


.90 


.87 


.75 


.75 




.67 


.46 


.79 


.96 


.54 


-.05 


Thigh Shape 


.71 


.65 


.94 


.88 


.78 




.88 


.72 


.70 


.59 


-.20 


Leg Space 


.56 


.50 


.45 


.37 


.80 


.42 




.52 


.57 


.70 


-.22 


Calf Shape 


.78 


.79 


.74 


.65 


.81 


.77 


.41 




.77 


.74 


-.32 


Overall Rating 


.91 


.90 


.76 


.89 


.84 


.85 


.39 


.76 




.67 


-.25 


Gen or Br Size 


.73 


.67 


.51 


.62 


.77 


.68 


.54 


.75 


.68 




-.35 


Pubic Hair 


.21 


.26 


-.02 


.46 


.12 


.20 


-.26 


.11 


.49 


.08 





